On the Sign Problem in the Hirsch-Fye Algorithm for Impurity Problems 
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We show that there is no fermion sign problem in the Hirsch and Fye algorithm for the single-impurity 
Anderson model. Beyond the particle-hole symmetric case for which a simple proof exists, this has been known 
only empirically. Here we prove the nonexistence of a sign problem for the general case by showing that each 
spin trace for a given Ising configuration is separately positive. We further use this insight to analyze under what 
conditions orbitally degenerate Anderson models or the two-impurity Anderson model develop a sign. 
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Quantum impurity problems describe the interaction of an 
electron gas with an impurity possessing internal degrees of 
freedom and, therefore, a dynamics of its own. ' To study the 
non-trivial physics involved, it has proven useful to develop 
numerical methods which are exact. One widely used "impu- 
rity solver" is the Monte Carlo algorithm developed by Hirsch 
and Fye for the Anderson model. ^-^^ This algorithm is both 
simple and useful as one only keeps track of the impurity- 
impurity Green function during the Monte Carlo updates. Al- 
though it was originally developed to study the simplest form 
of the Anderson Hamiltonian, this algorithm has found ap- 
plication in the context of dynamical mean field calculations^ 
and, more recently, the mesoscopic Kondo problemi^ 

One reason for the success of the Hirsch-Fye quantum 
Monte Carlo algorithm is that it is free of problems caused by 
the negative sign that results upon permuting two fermions. 
Such problems tend to plague fermionic quantum Monte 
Carlo algorithms.'''^ In the Hirsch-Fye case, the absence of 
such a "sign problem" can be proved easily if particle-hole 
symmetry is preservedi^ and has been known empirically in 
the general caseAlS Here we provide a formal proof of the 
absence of any sign problem in the general case. The proof 
relies on the simple fact that the single impurity problem is 
effectively one-dimensional, and so there is no fermionic per- 
mutation sign. 



The Anderson single-impurity Hamiltonianiii is 
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We do not make any particular assumption on the values of 
the energies eka, the couplings Vfc, or the impurity parame- 
ters U and eda- Using the Trotter product formula,'^ one can 
calculate the partition function in the limit 



where t = (3/M. For each time slice ^ = 1, . . . M, an aux- 
iliary Ising variable is introduced to decouple the spin- 
up and spin-down parts in Hi using the discrete Hubbard- 
Stratonovich transformation, 
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where A is a constant satisfying the relation cosh(A) = 
exp(r[//2). Then, the partition function can be computed as 



Z = 5]Zt(s)Z4(s), 



(6) 



where the sum is over all possible spin configurations s — 
(si, . . . , sm) and the spin-up and spin-down partition func- 
tions, ^i(s) and ^x(s), are given by 
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with e{]) = 1 and e{[) = -1. In the Hirsch-Fye algo- 
rithm, Ising configurations {s} are generated according to the 
weight Z|(s)Z|(s) using a Metropolis accept/reject step. For 
the half-filled Anderson model with particle-hole symmetry, 
it can be shown easily that the product Z|(s)Z|(s) is always 
positive.'' It is, however, empirically found that Za{s) itself is 
always positive for every s, even in the general case. 

To prove this, it suffices to find a basis of the fermionic 
Hilbert space, independent of the Ising variable s^ , in which 
all the matrix elements of e^^'^^'^'^^"''^'' are positive. To 

do this, we cast the problem in a one-dimensional form, as 
follows. First, note that the impurity is coupled locally to the 
electron gas, through the single-particle operator 
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where V — v^fcl^^F- '^^'i therefore convert iJo to a 
tridiagonal form of single-particle operators, or equivalently 
into an open fermion chainjiiiiii^ii^ 
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where 

hj. = a.flf,. + f3*flfj+la + P,f]+^Jja (10) 

with /3jv = 0, /oo- = rfff, and /Jq = V^- The actual values of the 
parameters aj and j3j for given e^'s and Vfc's can be obtained 
in practice using the Lanczos algorithm with /i as the initial 
operator. N^r — X^i flafio- is the total number operator. 

We first note that the parameter A can be chosen such that 
all the Qfj's in the spin chain are positive. Furthermore, by 
writing /3j = \ /3j\e'^^ and performing the gauge transformation 

/j = cxp( + z^(/.™) o->i), (11) 

Eq. dlOl l is cast in a form where the fj's are replaced by /j's 
and all the coefficients /3j are replaced by the positive real 
numbers \f3j\. As a consequence, with the occupation number 
states {\nQa- , nia- , , ■ ■ ■)} as the basis of the spin-ci Fock 
space (where Ujcr = 0, 1) and the phase convention 

\nOa---nNa) = f Na ■ ■ ■ f la f Oa \0), (12) 

all matrix elements of ~T{H^a — ATVo-) are positive. Since 
the operator N^r commutes with -ffocr, all matrix elements of 
exp(— rifotr) = exp(— r[iJoCT — AiVcr]) exp(— tATVct) are pos- 
itive, as are those of exp[9{a)Sf^Xnd(7]- Note that the basis 
states are eigenstates of Uda = d^da — foa-foa- The trace in 
Eq. Q is, then, positive. 

Thus because of its essentially one-dimensional nature, the 
single impurity Anderson model has no sign problem in the 
Hirsch-Fye Monte-Carlo algorithm for any choice of param- 
eters (in fact each spin determinant is separately positive). 
These considerations may be applied to a large class of mod- 
els, thus indicating without any numerical effort whether a 
model has no sign problem or whether it is likely to have one. 
We now discuss an example of each case. 

(1) Orbital- and Band- degenerate Anderson model: Con- 
sider an atomic impurity in a metal whose Fermi surface is 
rotationally invariant (this approximation may be relaxed). 
Additionally, as is the case for most transition metal or rare 
earth impurities, let the impurity's outer shell be orbitally de- 
generate (Z = 2, 3 as the case may be). Consider a general 
density-density interaction between the orbitals of the impu- 
rity, X)q/3 Uaprianp where a, (3 are the combined orbital and 
spin indices ma. This type of orbitally degenerate impurity 
model was studied, for instance, in Ref.[T3 (note that I = 
corresponds to the usual single impurity Anderson model). 



Because of the rotational invariance, for each orbital a on 
the impurity there is one particular linear combination of elec- 
tron gas states, ^f^, which couples to it. In fact, a is a con- 
served quantity, and so we may separate the a channels into 
independent one-dimensional (1-D) quantum channels, as in 
Eq. jlOt . each written as a semi-infinite spin chain. Thus we 
have 2(2^ + 1) channels that are coupled only by the the quar- 
tic interaction terms Uap at the impurity. Each quartic term 
may be split into quadratic terms using a discrete Hubbard- 
Stratonovich- field Sap- Then, Z ~ IIq^i^^^ ■^a with 

M 

where O^p = 1 if a > /3 and Oap = —dpa- Using the same argu- 
ments as for the single impurity problem, we can write each 
Za as a product of matrix elements that are positive. Thus 
we have shown that the orbitally degenerate Anderson model 
considered here has no sign problem. 

(2) Two-impurity Anderson model: As an example where 
the above ideas indicate the presence of a sign problem, con- 
sider two Anderson impurities embedded in an electron gas. 
Since the single impurity problem does not suffer from a sign 
problem, one may be tempted to naively hope that this is also 
the case for the two-impurity model. However, since there are 
two impurities at different locations in the electron bath, the 
bath may not be written as a sum of independent 1-D quantum 
channels. Thus fermion world lines in imaginary time may 
permute, leading in general to a sign problem in fermionic 
quantum Monte-Carlo. In the special case of particle-hole 
symmetry, it has been shown that the contributions from Z| 
and Zi always have the same signpii^ and thus there is no 
sign problem. 

In summary, we have shown that the Hirsch-Fye algorithm 
for the single impurity Anderson model does not suffer from 
a sign problem for any value of the temporal discretization t 
or any values of the parameters in the Hamiltonian. The key 
property underlying the proof is that the local interaction al- 
lows one to transform the Hamiltonian into a one-dimensional 
chain for which there is no fermionic permutation sign. We 
also considered two more complicated models to show how 
these ideas can be used either to prove the absence of a sign 
problem or to explain the reason for the presence of one. 
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